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Abstract 

In this article, we derive a new generalization of Chebyshev inequality for random vec- 
tors. We demonstrate that the new generalization is much less conservative than the classical 
generalization. 



1 Classical Generalization of Chebyshev inequality 

The Chebyshev inequality discloses the fundamental relationship between the mean and variance 
of a random variable. Extensive research works have been devoted to its generalizations for 
random vectors. For example, various generalizations can be found in Marshall and Olkin (1960), 
Godwin (1955), Mallows (1956) and the references therein. A natural generalization of Chebyshev 
inequality is as follows. 

For a random vector X G R" with cumulative distribution F{.), 

Pr:{\\X-E[X]\\>e}<'^^^^ Ve > (1) 
where 1 1 . 1 1 denotes the Euclidean norm of a vector and 



YaT{X)=[ \\V - E[X]\\^dF{V) 



This classical generalization can be found in a number of textbooks of probability theory and 
statistics (see, e.g., pp. 446-451 of Laha and Rohatgi (1979)). 
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2 New Generalization of Chebyshev inequality 



The classical generalization ([T]) perfectly assembles its counterpart for scalar random variables. 
However, it may be too conservative. To address the conservatism, we derive a new multivariate 
Chebyshev inequality as follows. 

Theorem 1 For any random vector X G R" with covariance matrix S, 

Pr|(X-£;[X])^S~^(X-^[X]) > e} < ^, Ve > (2) 
where the superscript 'T " denotes the transpose of a matrix. 

Proof. Let = {V e R" : {V - - E[X]) >e}. By the definition of D^, we 

have 



Hence, 



^{v - E[x]yj:-\v - E[x]) >i, yveTis 



Pr{XGDj <-[ {V - E[X])'^J:-\V - E[X])dF{V) 
- [ {V-E[X]y^-\V-E[X])dF{V). 



< 
e 



For « = !,••• , n, let Mj denote the i-th element oi V — E[X]. For i = 1, • • • ,n and j = 1, • • • , n, 
let (Tjj denote the element of S in the i-th row and j-th column. Similarly, let pij denote the 
element of in the i-th row and j-th column. Then, 

n / n \ 

{v-e[x])'^j:-\v-e[x]) = ^uAY^P^kUk] 

i=i \k=i J 

n n 
i=l k=l 

It follows that 



{V - E[X])'^J:~'^{V - E[X]) dF{V) 

V& R" 

// n n \ 
Ve R" \ ~T / 

n n 



,i=l k=l 



ve R" 

n n 

Ui Uk dF{V) 

v& R" 



ik 

i=l k=l 



By the definition of the covariance matrix T, and its symmetry, we have 

/ Ui Uk dF(y) = aik = <7ki 
J Ve R" 
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for i = 1, • • • , n and k = 1, - ■ ■ ,n. Hence, 

/ {V-E[X])'^^-\V-E[X])dF{V) 



n n 



i=l fc=l 

tr(S-^S) 



n 



where tr(.) denotes the trace of a matrix. Therefore, 



e 



The proof is thus completed. □ 

Remark 1 Theorem [I] indicates a fundamental relationship between the mean and covariance of 
a random vector and describes how a random vector deviates from its expectation. Specially, for 
n = 1, we have T, = Var(X) and by TheoremlJl for any e > 0, 



Ft \^{X - E[X]y^-\X - E{X]) > e} 
Pr|||X - E[X]\\ > Var(X)| 



1 
e 

from which we deduce 

Fr{\\X-E[X]\\>e}<'^ 

by letting e = \J e Var(X). This shows that Theorem [I] includes the well-known Chebyshev in- 
equality as a special case. 

3 Comparison with Classical Generalization 

In this section, we shah show that the inequahty in Theorem [T] can be much less conservative 
than the classical generalized Chebyshev inequality ([T]). 

Let S G (0, 1). Based on inequality ([T|), sphere 

Bs = |y G R" : ||y - E[X]\ |2 < ^ 
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is the smallest set that can be constructed to ensure Pr{X G B^} > 1 — 6. On the other hand, 
by applying Theorem [T] we can construct an ellipsoid 

def 



E 



<5 



{f G R" : (F - E[X]yj:-\V - E[X]) < ^} 



which guarantees Pr{X £ Eg} > I — 5. 

For a comparison of the conservativeness of generalized Chebyshev inequalities ([T]) and ([5]) , it 
is natural to consider the ratio where vol(.) is a volume function such that vo^S") = /^g^ dv 

for any S C R". Interestingly, we have 

Theorem 2 For any random vector X e R", 

'tr(E) 



vol(B^ 



vol(E5) y/det(S) 
where det(5]) is the determinant ofL. 



> 1 



Proof. By the definitions of variance and covariance, we have Var(X) = tr(S). It follows that 

vol(B5) = K 



trfS) 



6 J 

where > is a constant. Applying a linear transform u = S~2(ti — to the integration 

vol(E5) = dv, we have 

vol(E5) = det(S^) [ du= x/det(S) K f a/t1 

J||n||2<f VV Oj 

and thus 

vol(B5) 



To show > 1, it is equivalent to show 



vol(E5) 7d^t(S) 
show 

^ > [det(S)]i 
n 

Recall that the geometric average is no less than the arithmetic average 

1 

/ n \ 



tr(S)_EILr-.^ Jj^^r, (3) 



n n 



\i=l / 

where an, i = 1, ■ ■ ■ ,n are the diagonal components of S. Note that the covariance matrix S is 
positive definite, hence by Hadamard's inequality, 



det{J:) < II an. (4) 



i=l 
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It follows from ^ and ^ that ^^^^ > [det(S)]n . The proof is thus completed. 
As an illustrative example, consider a two-dimensional random vector 



□ 



X 



y 

y + z 



where y and z are independent Guassian random variables with zero means and variances o"^ , ka"^ 
respectively. Straightforward computation gives 



a a 

cj2 (A: + 1)(t2 



and 



vol(B6 



k + 2 



> V2. 



vol(E5) 2y/k 

Obviously, as k increases from 2 to oo or decreases from 2 to 0, the ratio of volumes increases 
monotonically and tends to oo. 

In the following Figure [H ellipsoid and sphere are constructed for u = 1, k = 25 and 
5 = 0.1. Moreover, 1000 i.i.d. samples of X are generated to show the coverage of the ellipsoid 
and sphere. It can be seen that most samples are included in the ellipsoid. This indicates 
that Theorem [1] is much less conservative than the classical generalized Chebyshev inequality in 
describing how a random vector deviates from its expectation. 



References 

[1] H. J. Godwin, "On Generalizations of Chebyshev Inequality," Journal of the American Sta- 
tistical Association, pp. 923-945, Vol. 50, No. 271, 1955. 

[2] R. G. Laha and V. K. Rohatgi, Probability Theory, pp. 446-451, John Wiley and Sons, 1979. 

[3] C. L. Mallows, "Generalizations of Chebyshev Inequalities," Journal of the Royal Statistical 
Society, Series B, pp. 139-171, Vol. 18, No. 2, 1956. 

[4] A. W. Marshall and I. Olkin, "Multivariate Chebyshev Inequalities," The Annals of Mathe- 
matical Statistics, pp. 1001-1014, Vol. 31, No. 4, 1960. 



5 



